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Abstract —Self-powered, energy harvesting small cell base sta¬ 
tions (SBS) are expected to be an integral part of next-generation 
wireless networks. However, due to uncertainties in harvested 
energy, it is necessary to adopt energy efficient power control 
schemes to reduce an SBSs’ energy consumption and thus ensure 
quality-of-service (QoS) for users. Such energy-efficient design 
can also be done via the use of content caching which reduces the 
usage of the capacity-limited SBS backhaul, of popular content 
at SBS can also prove beneficial in this regard by reducing 
the backhaul usage. In this paper, an online energy efficient 
power control scheme is developed for an energy harvesting SBS 
equipped with a wireless backhaul and local storage. In our 
model, energy arrivals are assumed to be Poisson distributed 
and the popularity distribution of requested content is modeled 
using Zipf’s law. The power control problem is formulated as 
a (discounted) infinite horizon dynamic programming problem 
and solved numerically using the value iteration algorithm. 
Using simulations, we provide valuable insights on the impact of 
energy harvesting and caching on the energy and sum-throughput 
performance of the SBS as the network size is varied. Our results 
also show that the size of cache and energy harvesting equipment 
at the SBS can be traded off, while still meeting the desired system 
performance. 

Index Terms —Energy harvesting. Green communications. 
Edge caching. Small cells. 

I. Introduction 

The exponential increase in mobile data traffic has led to 
the advent of small cell networks as a promising solution to 
meet the ever increasing demand for the wireless spectrum 
0,0- Erom the perspective of mobile operators, rural areas 
present a great business opportunity for deploying small cells 
due to increased coverage, subscriber base, and paid usage per 
subscriber j^. However, there are two main challenges in rural 
small cell deployment: energy efficiency and backhaul avail¬ 
ability. Many locations, especially in emerging markets, have 
limited or no access to the conventional power grid and, thus 
they need to harvest energy from other, renewable sources, 
such as solar. The amount of energy harvested fiuctuates over 
time resulting in potential power outages at the SBS and thus 
degrading the QoS for the users. Therefore, it is imperative to 
design and implement energy-efficient transmission schemes. 
Moreover, rural small cells are often outside the normal 
economic reach of existing operator backhaul infrastructure. 
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This significantly increases the backhaul cost and thus limits 
the backhaul capacity, making it difficult to deliver high speed 
mobile broadband coverage. 

Resource allocation for energy harvesting wireless commu¬ 
nication systems has been studied extensively 0-|[^. While 
some of the resource allocation schemes 0, 0 focus on 
maximizing energy efficiency for a small cell network, they 
do not consider energy harvesting. Other works focus on 
optimizing either sum throughput 0 or delay performance 0 
rather than the energy efficiency of renewable energy powered 
systems. Only recently there has been some work 0 0 
done on minimizing power consumption in renewable energy 
powered cellular networks. The authors in formulated an 
optimization problem to adapt the BSs’ on-off states, active 
resource (spectrum) blocks and renewable energy allocation to 
minimize the average grid power consumption while satisfying 
users’ QoS requirements. However, the limitation of this work 
is that it assumes that the energy arrivals are known non- 
causally and BSs’ use on-off power control rather than using a 
variable power control. Also, both and assume hybrid 
BSs’ with access to both power grid and renewable energy. 
However, this may not be a realistic assumption for rural 
small cells, which have little to no-access to power grid. 
Therefore, it is desirable to develop online energy-efficient 
power control schemes for purely renewable energy powered 
small cell networks, while ensuring a best effort QoS for users. 

Beyond adopting energy-efficient transmission schemes, one 
can also cache popular content at the level of the base stations 
to further reduce the amount of energy consumed in the 
network. Caching of popular content reduces the backhaul 
usage for downloading user data and thus ensures QoS during 
peak traffic demand^ The idea of edge caching was first 
proposed in fT0| , GD in which a new architecture for wireless 
video distribution based on distributed caching of popular 
content at the level of small cells. It studied the problem 
of optimal content placement across distributed caches such 
that the expected sum delay in downloading users data is 
minimized. This work was extended in (H GD to include 
the notion of proactive resource allocation exploiting the 
predictability of user behavior for load balancing. Recently, 

^Caching of popular user data is particularly beneficial for SBS because 
they typically have weak backhaul links with limited bandwidth. 
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Fig. 1: System Model 


the authors in 0 proposed a low complexity scheme for 
updating cached content in a small cell network. Nevertheless, 
while interesting, these works primarily focus only on content 
placement and update so as to minimize the total delay in 
downloading the user data. The impact of caching on the 
energy consumption and backhaul usage for the small cell 
network is yet to be explored. This is particularly important 
for renewable energy powered small cell networks with limited 
battery capacity and backhaul bandwidth. 


The main contribution of this paper is to develop an 
online energy-efficient power control scheme for an energy 
harvesting SBS that is endowed with caching capabilities 
and a wireless, capacity-limited backhaul. Energy arrival are 
modeled as Poisson process and the popularity distribution of 
user data is modeled using Zipf’s law. The utility function of 
the SBS is a generalized energy-efficiency function that alters 
the degree of energy efficiency depending upon the current 
battery level. We formulate the power control problem at the 
SBS as a (discounted) infinite horizon dynamic programming 
(DP) problem that maximizes the average energy efficiency 
of system subject to certain power constraints for the SBS. 
The DP problem is solved numerically using a proposed value 
iteration algorithm. Simulation results indicate that increasing 
cache size and/or energy harvesting capability increases energy 
availability at SBS. Interestingly, this comes at a gain in sum 
throughput for the proposed scheme as compared to the sum 
throughput maximization scheme. Finally, we show that for a 
given performance criteria, it is possible to trade off the energy 
harvesting capability for cache size. 


The rest of the paper is organized as follows. Section 

we formulate 


introduces the system model. In Section III 


the optimization problem to determine the transmit powers 
on downlink and backhaul. We then propose a value iteration 
algorithm to solve this problem. Section [^presents simulation 
results. Finally Section [V| draws some conclusions. 


II. System Model 

Figure shows the system model of an SBS serving Nu 
mobile users. The SBS is equipped with a local cache of size 
M and is connected to the core network using a wireless 
(licensed spectrum) backhaul link. We also assume that the 
SBS is self-powered and it obtains its power supply through 
an energy harvesting device that is connected to a rechargeable 
battery with capacity E’max- 

In this model our goal is to study the impact of caching 
and energy harvesting on resource allocation in a SBS. In our 
case, resources consist of power and bandwidth allocated to the 
users. The scheduler at the SBS performs resource allocation 
at the start of each time slot of duration T seconds. Let G 
[0, E’max] be the energy remaining in the battery at the start of 
the /c* time slot. Then the evolution of Ek over time can be 
written recursively as, 

Ek-\-i = mm{Ek — PkT + Ek, F^max), V /c = 0,1, 2,... (1) 

Here, Ek is a random variable denoting the energy harvested 
during the /c* slot. The energy arrivals are typically modeled 
as a Poisson process with mean A [|T5]|-fT7|. Let q be the 
amount of energy harvested at each arrival, which depends 
on the capability of the energy harvesting device present 
at the SBS. So Ek = NaQ, where Na is the number of 
arrivals in time T with a mean value of AT. The variable 
Pk e [0,min(Pn,ax, ^)] in ([T]( represents the total transmit 
power of the SBS during the slot. Pmax is the maximum 
transmit power constraint on the SBS, but the actual upper 
bound is min(Pniax, because the energy remaining in the 
battery cannot be negative at any instant. The total power Pk 
can be written in terms of its constituents as, 

Nu 

Pk = + ^Pb,k, (2) 

where Pi^k is the transmit power on downlink for user i during 
















the /c* slot. Similarly, P 5 is the SBS transmit power spent 
on fetching the user requested content from the core network 
using the backhaul. The backhaul link is accessed with a 
probability e, which is relatec 0 to the probability of cache miss, 
Cm, such that e = 1 — (1 — We assume that the SBS 

caches the M most popular files among the users, because 
the probability of users requesting these files is more than 
other files and thus minimizes the backhaul usage for fetching 
the requested content from the core. Therefore, caching the 
popular data is likely to result in higher energy savings and 
lower latency than just randomly caching user content. We 
model the content popularity distribution using Zipf’s law 
which states that the frequency of an element (file) of rank 
j in a set of R elements is given as, 

ms,R) = -i^ ( 3 ) 

Er=l 

where s > 1 is a decay constant characterizing the peakiness 
of the distribution: a large value indicating that a very small 
number of files account for majority of data traffic. The rank 
of a file indicates its relative popularity, with a lower rank 
indicating higher popularity. The probability of cache miss, e, 
is the probability that one of the files that has not been cached 
is requested by the user and can be calculated as. 


R 

e= X] 

j=M+l 


J2j=M+l 

Eti 


( 4 ) 


For a given resource (bandwidth, power) allocation and 
battery level, we define the utility of the SBS at time slot 
k as. 


Et“iW"aiog2(i + 7i,fe) 


Pk") — 




gi^k) 


( 5 ) 


where Wi^k is the bandwidth allocated to the i* user and 
the backhaul respectively during the /c* sloj^ For simplic¬ 
ity, we have Wk = [VFi,/c, VF 2 ,/c, * * * and pk = 

[Pi,k^ P2,kr '' ^PnuM- variables ^i^k in ^ denotes the 
received signal-to-noise ratio (SNR) at the user at /c* slot, 
and are given by. 


Pi,k\\hi^k\f 

dfa‘^ 


( 6 ) 


where hi^k denotes the downlink channel between the SBS and 
i* user, di is the distanc^ between the SBS and the user 
and a is the path loss exponent. All the channels are assumed 
to be i.i.d., Rayleigh fading channels, is the variance of the 
Gaussian noise. 


^The backhaul is accessed for fetching the files from the core network if 
atleast one of hies requested by the Nu users is not present in the cache. The 
probability that all the users hnd their requested hies in cache is (1 — ■ 

Therefore probability of using backhaul is 1 — (1 — • 

^In LTE, the scheduler allocates the bandwidth to a UE at each TTI in 
multiples of Physical Resource Block (PRB), where a PRB comprises of 12 
subcarriers each 15 kHz wide. 

^We assume that the users are stationary over the time duration of interest. 


When the user-requested data is not present in the local 
cache at SBS, then the requests must be forwarded to the 
core network via backhaul. When it receives the data from 
core network, the SBS transmits it back on the downlinlQ 
Let 75 denote the received SNR at the core network when 
the backhaul is used to fetch the files from the core network. 
75 can be written as. 


7b,k = 


Pb,k\\hb,k\f 

d^a‘^ 


( 7 ) 


where h^^k denotes the Rayleigh fading channel between the 
SBS and the core network, d^ is the distance between the SBS 
and the core network. The SBS transmit power on backhaul, 
Pb^k^ should be large enough so that ^b,k ^ 7min at each time 
slot k. Otherwise, the receiver at core network cannot correctly 
decode the files requested by the users. 

The function g{Ek) in alters the degree of energy 
efficiency in next time slot depending upon the current battery 
level, Ek. Although many functions can be used, we define 
9{Ek) as, 

g{Ek)=a+ (8) 


where a and b are constants (a > 6 > 0 ), that determine the 
extent to which Ek infiuences energy efficiency. We choose 
this function because it is desirable to be more energy efficient 
when battery level is low, due to uncertainty in harvested 
energy. Clearly, the function g{Ek) in ^ satisfies this and 
is a non-increasing function of Ek. Also, both g{Ek) and Uk 
are well-defined at all values of Ek. 

We now determine the average utility of the SBS, 
U^^{wk^Pk: Ek), by averaging over all possible channel 
realizations as following. 


UfJ^{wk,Pk^Ek) = Ehk {Uk{wk,Pk,hk,Ek )), (9) 


Eh. (e7i 




( 10 ) 


where lEhfc(-) denotes the expectation operation over the 
channel vector hk = [hi^k^ ^ 2 ,/c 5 * * * 5 ^Ar^,/c]- Equation 
follows from substituting ([ 5 ]) and ([^ in 0. Since we assumed 
the channel to be Rayleigh fading, the squared norm of the 
channel, Hi^k = ||^i,/c|| , exponentially distributed with 
some rate parameter, g V i^k, and is given by. 


( 11 ) 

Then using ( p^ and ( pT| ), we have, 

, E7i Wi,k /o“ log2(l + 

Uk ^{wk,Pk,Ek) = - 


Pi,k 


,9iE/k ) 


( 12 ) 


^The contents of the cache may be updated when new data is downloaded 
using backhaul, if hie popularity distribution has changed over the course of 
time. 












Let us solve the integral / = log 2 (l + ^^dx. Let 

r = Applying integration by parts to /, we have, 


1 = 


li ln(2) 


—ln(l + rx)e + 
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-Q-^^dx 


li ln(2) Ji± z 


/: 


-dz 


fj,d^ a'^ 2 

e^r(0,^) 

li ln(2) 


(13) 

(14) 


where ( p^ follows from ( p^ by noting that lima^^oo —ln(l + 
rx)t~^^ = 0 (using L’Hospital’s rule) and by setting 2 : = 
/i(x + ^). Then noting that the integral is a upper incomplete 
Gamma function, r(0, ^) and substituting back the value of 
r, we get the final expression in ( p^ . Substituting the solution 
of the integral in we get. 








Ul''^{wk,Pk,Ek) = 




(15) 


III. Problem Formulation and Solution 
Methodology 

In this section, we first formulate the optimal power control 
problem at the SBS as an infinite horizon dynamic program- 
min^DP) problem and then present a solution approach for 
finding the optimal transmit power at each time slot. 

For the system model described in the last section, the 
problem at the SBS is that of optimal power control for 
given energy Ek and channel state hk at time slot k. It 
is determined by solving for the power control scheme that 
maximizes the sum of current and (discounted) future utility. 
Mathematically this is given as. 


transmission policy 7r^{Ek) and is defined iteratively as. 


V^,{Ek) = UP{wk,Pk,Ek) 

+ <) Y P{Ek+i/Ek,Pk)V7rf{Ek+i), (19) 


where pk = 7r^{Ek). Note that the value function uses the 
average utility function defined in ([^. 

The policy ir^Ek) is the one that maximizes the value 
function I4(L^/c), subject to certain power constraints. So we 
have. 


TT^Ek) = argmax U^''^{wk,Pk,Ek) 

Pk 

+ ^ 'P{Ek-\-i/Ek^Pk)V^t{Ek-\-i), 

Ek+i 

( 20 ) 


subject to ([Tt},®. 


The backhaul power, P^^/c in ( p^ is set such that = 7min- 

It is not possible to obtain a closed form solution to ( p^ , 
because the objective function depends on the value of next 
state which in turn depends on the value of next-to-next stage 
and so on. Therefore, we need to solve the DP problem 
numerically. Policy iteration and value iteration are the two 
popular algorithms for numerically solving the DP. Policy 
iteration converges quickly, but it requires search over set of 
all feasible policies which is typically a very large set. On the 
other hand, value iteration iteratively updates the value of each 
state by determining the actions that would maximize the value 
of that state. Therefore, the search is over a much smaller set. 
The drawback is slow convergence. We decided to use value 
iteration to solve the DP in ( p^ . However, before doing that, 
we would need to discretize the state space and action space. 
The detailed algorithm is described in Algorithm 1. 

IV. Simulation Results 


pl{Ek, hk) = a.vgmax Uk{wk,Pk,Ek,hk) 

Pk 

+ ^ ^ P(P/c+l/P/c,P/c)K-t(P/c+l), (16) 

Ek+1 

such that 

> 0,v* = (17) 

Pi^k + ePb,k < min(Pmax, ^)- (18) 

i=l 

The backhaul power, in ( p^ is set such that "fb,k = 7min- 
If it turns out that ^ Pb k = 

Pi,k = 0. 

(5 G [0,1) is a discount factor for the utility of future states. 
P{Ek-\-ilEk,Pk) denotes the transition probability from en¬ 
ergy state Ek to P/c+i when the transmit power in the /c* 
slot is Pk. I4t(P/c+i) is the value of state P/c+i under the 

^The SBS continually serves the users that are associated to it as long as 
the energy in the battery is above a particular threshold, so it is reasonable to 
consider an inhnite-horizon problem. 


For simulations, we consider a rural small cell network 
in which the SBS is located at the center and Nu users 
are deployed randomly within a circle of radius 800 m. The 
separation between the SBS and cor^ is set to 3 km. The 
battery capacity Pmax is 2 J and the maximum transmit power 
of the SBS, Pmax is 0.8 W. The amount of harvested energy 
per arrival is set to g = 80 mJ, while the time slot duration is 
set to T = 1 ms. The total number of files that the users can 
request, N, is assumed to be very large for practical purposes. 
These files are assumed to be of same size and the cache size 
M represents number of files cached. The exponent 5 in ([^ is 
set to 2. The fading parameter li in {TT} is 1. The constants a 
and 6 in ([^ are set to 0.18 and 0.03 respectively. The discount 
factor ^ = 0.7. The minimum SNR for backhaul, 7nun is set to 
8 dB. The value of path loss exponent,^, is set to 3. The noise 
variance is set to —90 dBmW. Since the focus of this work 
is to understand the impact of energy harvesting and caching 
on the downlink resource allocation at SBS, for simplicity, we 

^If the separation between SBS and core is huge, relay nodes or macroBS 
may be deployed to relay the backhaul data to the core. 















Algorithm 1 Proposed Value Iteration Algorithm 
Procedure: Valuejteration {£, 

Inputs 

£ = {0,1, • • • , E’max} is the set of all energy states 
A is the set of all transmit power vectors, p 
V is the state transition function specifying V{E jE^p) 
is the utility function U{p^E^ h) 

6> is a threshold, 6> > 0 
Outputs 

7r^[f] is optimal policy 
V[£] is the value function 

Local 

real array Vm[£] is a sequence of value functions 
action array 7r^[f] 

Begin Algorithm: 

Vo[E] ^0 \/E^£ 

m ^ 0 

repeat 

m ^ m 1 

for £’ = 0 to E’max do > Update value of each state 
Vm{E) = maxpe^ U^''^{wk,p, E) + 
SEe' V{E'/E,p)Vm-i{E') 

end for 

until VS, \Vm[E] - K,_i[S]| < e 

for = 0 to Emtoi do > Determine the optimal policy 

t:\E) = argmaxp^g^l7‘"'8(mfc,p,£;) + 

^Ee' V{E'IE,p)V,n{E') 

end for 
return 


assume equal bandwidth, W = 100 kHz, for each user and 
backhaul. 

Figure shows the variations in the energy available at 
SBS over time. The available energy decreases monotonously 
with time except for the time instants with energy arrivals 
or low battery level. When the battery level is low, the SBS 
enters energy-saving mode i.e., it remains idle when channel 
conditions are bad and until more energy is harvested.The 
rate of decrease in energy decreases with decrease in available 
energy at the SBS. This is due to the function g{Ek) in in <0 
that makes the SBS more energy-efficient when the battery 
level is low. Figure also indicates the energy arrivals and 
time slots for which the SBS is idle (no transmission). We 
note that energy arrivals are infrequent because A is small. 

Figure shows the plot of average energy remaining in 
the battery as a function of the number of users for different 
cache size M and energy harvesting rate A. We note that for 
a given energy harvesting rate, the available energy in the 
battery decreases sharply as the cache size is decreased. This is 
because the probability of miss, increases with the decrease 
in cache size. Therefore, the SBS will start using the backhaul 
more aggressively and, thus the energy expenditure increases. 
For = 10 and A = 2 s“^, caching two files as opposed 
to none, results in 40% higher energy savings. In Figure 



Fig. 2: Energy dynamics for M = 80 and A = 0.1. 



Fig. 3: Impact of energy harvesting and cache size on available 
energy. 


we also note that, as increases, the energy expenditure 
increases due to higher probability of backhaul usage, given 
by e = 1 — (1 — Finally, we note that the degradation 

in (energy) performance due to the decrease in energy arrival 
rate (A : 2 1.2) can be compensated by increasing the cache 

size (M : 2 ^ 6 ^ 12). 

Figure shows the average sum throughput of users as the 
number of users varies for different cache size. The rate of 
energy arrivals is A = 2 s“^. We note that sum throughput 
increases with the increase in cache size. This is due to the 
fact that the frequency of backhaul access becomes smaller 
and thus more power is available for downlink transmissions. 
In this figure, we also compare the throughput performance 
of our proposed power control scheme with a sum throughput 
maximization schem^ We note that, contrary to intuition, our 
scheme results in higher throughput (20% gain at {Nu^ M) = 
(11,6)) than the sum throughput maximization scheme. This 
is because in case of sum throughput maximization scheme, 
the SBS transmits at its maximum power level while being 
oblivious to the channel state information. In the case of a deep 
fade, this will exhaust the battery power. If this is followed 
by a period of low energy arrivals, then the SBS will not 
be able to transmit at high power levels even in excellent 

^The sum throughput maximization scheme can be obtained from the utility 
function defined in ^ by setting the denominator to 1. 



























Fig. 4: Impact of energy harvesting and caching on throughput. 



Fig. 5: Effect of cache size and energy harvesting on energy 
available in system. 

channel conditions. This results in a significant loss in the 
sum throughput compared to the proposed scheme. 

In Figure we show the impact of jointly varying the 
cache size M and the energy harvested per arrival q on the 
energy availability at SBS. Nu is set to 15. We note that 
increasing M from 1 to 160 or from 0.1 to 0.9, increases 
the energy availability. Increasing q however has a more 
pronounced effect than increasing M. This is because we 
cache files in order of decreasing popularity, so increasing M 
results in diminishing returns. In order to achieve a desired 
(energy) performance, the cache size and energy harvesting 
capacity can be traded off. This is illustrated in Fig. 0by 
considering the points (M, q) = (40, 0.7) and (120, 0.5) which 
correspond to roughly same available energy of 0.63 J. The 
practical implication of this result is that a network operator 
can make a better decision (after factoring in the storage and 
energy harvesting equipment costs) about the desired cache 
size and size of energy harvesting device that achieves desired 
performance. 

V. Conclusions 

In this paper, we have presented an energy efficient power 
control scheme for an energy harvesting SBS equipped with 
a wireless backhaul and local storage. We have formulated 
the power control problem as a discounted infinite horizon 


dynamic programming problem and solved it numerically 
using value iteration algorithm. Using simulations, we have 
revealed key insights on the impact of caching and energy 
harvesting on the energy consumption at SBS as the number 
of users in system is varied. Increasing cache size or energy 
harvesting rate results in increased energy availability. The 
proposed scheme also provides higher throughput as compared 
to the baseline sum throughput maximization scheme. We have 
also shown that the cache size can be bargained for energy 
harvesting capability and vice versa, while still meeting the 
desired system performance. 
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